Deep learning?based multi?modal computing with feature disentanglement for MRI image synthesis

نویسندگان

چکیده

Purpose: Different Magnetic resonance imaging (MRI) modalities of the same anatomical structure are required to present different pathological information from physical level for diagnostic needs. However, it is often difficult obtain full-sequence MRI images patients owing limitations such as time consumption and high cost. The purpose this work develop an algorithm target sequences prediction with accuracy, provide more clinical diagnosis. Methods: We propose a deep learning based multi-modal computing model synthesis feature disentanglement strategy. To take full advantage complementary provided by modalities, utilized input. Notably, proposed approach decomposes each input modality into modality-invariant space shared modality-specific specific information, so that features extracted separately effectively process data. Subsequently, both them fused through adaptive instance normalization (AdaIN) layer in decoder. In addition, address lack test phase, local fusion (LAF) module adopted generate modality-like pseudo-target similar ground truth. Results: evaluate performance, we verify our method on BRATS2015 dataset 164 subjects. experimental results demonstrate significantly outperforms benchmark other state-of-the-art medical image methods quantitative qualitative measures. Compared pix2pixGANs method, PSNR improves 23.68 24.8. Conclusion: could be effective sequences, useful diagnosis treatment.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Hierarchical feature representation and multimodal fusion with deep learning for AD/MCI diagnosis

For the last decade, it has been shown that neuroimaging can be a potential tool for the diagnosis of Alzheimer's Disease (AD) and its prodromal stage, Mild Cognitive Impairment (MCI), and also fusion of different modalities can further provide the complementary information to enhance diagnostic accuracy. Here, we focus on the problems of both feature representation and fusion of multimodal inf...

متن کامل

A Bayesian approach for image denoising in MRI

Magnetic Resonance Imaging (MRI) is a notable medical imaging technique that is based on Nuclear Magnetic Resonance (NMR). MRI is a safe imaging method with high contrast between soft tissues, which made it the most popular imaging technique in clinical applications. MR Imagechr('39')s visual quality plays a vital role in medical diagnostics that can be severely corrupted by existing noise duri...

متن کامل

Deep Learning in Image Computing: An Overview

Deep learning is a growing trend in computing. It is an improvement to artificial neural network. Deep Neural Networks are used in image classification, detection and segmentation. In this paper, an overview is carried out about the usage of deep neural network in various areas of image computing including image quality assessment, document imaging, object recognition, medical imaging, content ...

متن کامل

Deep sketch feature for cross-domain image retrieval

Deep learning has been proven be very effective for various image recognition tasks, e.g., image classification, semantic segmentation, image retrieval, shape classification etc. However, existing works on deep learning for image recognition mainly focus on either natural image data or binary shape data. In this paper, we show that deep convolutional neural networks (DCNN) is also suitable for ...

متن کامل

Deep Graphical Feature Learning for Face Sketch Synthesis

The exemplar-based face sketch synthesis method generally contains two steps: neighbor selection and reconstruction weight representation. Pixel intensities are widely used as features by most of the existing exemplar-based methods, which lacks of representation ability and robustness to light variations and clutter backgrounds. We present a novel face sketch synthesis method combining generati...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Medical Physics

سال: 2021

ISSN: ['2473-4209', '1522-8541', '0094-2405']

DOI: https://doi.org/10.1002/mp.14929